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1 Introduction 

In a paper by Sapounakis, Tasoulas, and Tsikouras [8], the authors count 
the number of occurrences of patterns of length four in Dyck paths. In this 
paper we specify in one direction and generaUze in another. We only count 
ballot paths that avoid a given pattern, where a ballot path stays weakly 
above the diagonal y = x, starts at the origin, and takes steps from the 
set {ti^"} = {u,r}. A pattern is a finite string made from the same step 
set; it is also a path. Notice that a ballot path ending at a point along 
the diagonal is a Dyck path. Consider the following enumeration of ballot 
paths avoiding the pattern rur. 
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The number of ballot paths to (n, m) avoiding rur 



s„(m), the entry at the point (n, to), is the number of ballot paths from 
the origin to that point avoiding the pattern rur. We can generate this 



1 



table by using the recurrence formula 

s„(m) = s„(to - 1) + s„_i(m) - s„_i(m - 1) + s„-i(to - 2) (1) 

where so(™) — Ij and Sn(n — 1) = represents the weak boundary y = x. 
The above table is calculated using this recursion and suggests the columns 
are the values of a polynomial sequence. It will be shown that s„(m) is a 
polynomial in m. We shall present a theorem guaranteeing the existence 
of a polynomial sequence for a given recurrence relation and boundary 
conditions. 

If the number of ballot paths reaching (n, x) is the values of a polynomial 
sequence s„ (x) , the recurrence relation obtained can be transformed into an 
operator equation. Using the tools from Finite Operator Calculus in Section 
2, we can find an explicit formula for the polynomial sequence s„(x). 

In this paper, we will only consider patterns p such that its reverse pat- 
tern p is a ballot path. For example, the reverse pattern of p = uururrr is 
p = uuururr. We call such patterns depth-zero patterns. This is a require- 
ment in TheoremUl although for some patterns that are not depth-zero, the 
solution may be a polynomial sequence, but not for the entire enumeration. 
For patterns of nonzero depth see [5]. To develop the recursions, we need 
to investigate the properties of the pattern we wish to avoid. 

Definition 1 A nonempty string a G {u, r}* is a bifix of a pattern p if 
it can be written in the form p = op' and p = p"o for nonempty strings 
p',p" € {u,r}*. If a pattern has no bifixes, then we call it bifix-free. 

Definition 2 If a is the number of r's in p and c is the number of u 's, 
then we say p has dimensions axe, and d{p) — a ~ c. 

If o is a bifix for the pattern p, then we will see in Section 4 that we 
need that d{p") > 0. The following lemma shows that this restriction is 
not necessary when p is depth zero. 

Lemma 3 Ifp is a depth zero pattern and a is a bifix of p, then d{p") > 0. 

Proof. First we note the additive property of d, that is d{ab) = d{a)+d{b). 
By definition p = op' = p"o, which implies d{p') ^ d{p"). Since p is 
depth zero, any suffix of p is also depth zero, in particular p' is depth zero. 
Therefore, d{p') > 0, which implies d{p") > 0. ■ 



2 Main Tools 



In this section we will present the main tools from Finite Operator Calculus 
that will be used to solve these enumeration problems. As we noted be- 
fore, not every pattern we choose to avoid will have a polynomial sequence 
solution. The following theorem will illustrate why we want a depth-zero 
pattern. 

Theorem 4 Let xo,xi, ... be a given sequence of integers where Fn{m) = 
for m < Xn- For m> Xn define Fn (m) recursively for all n>0 by 

n 

Fn{m) =Fn{m-l) -h ^^Oiji^„_i(m - bij), 

i=l j 

where '^ai j =^ and with initial values _F'„(a;„). If Fo{m) = c 7^ for 

j 

all m > xo, and if for each j holds bij < x„ — Xn-i + 1 for n > 1 and 
i = 1, . . . , n, then there exists a polynomial sequence fn{x) where deg fn = n 
such that Fn{m) = fnim) for all m > Xn and n > (within the recursive 
domain). 

Before; wc prove this theorem, we look back at the example of ballot 
paths avoiding the pattern rur. 
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Here, Xn = n — 1 and Fn{xn) = <5n,o- The recursion satisfies the con- 
ditions bij < Xn — Xn-i + 1 = i + 1 and Yl c-ij = 1 7^ 0. In the table, 

j 

below the initial values are the polynomial extensions, which are not all 
0. Clearly, if the recursion required us to use values below these initial 



values, the values generated would not agree with the values generated by 
the polynomial extensions, thus we need the condition bij < a;„ — + 1, 
in general. We now prove Theorem 21 

Proof. We first let /o(a;) = Fo{xo), since Fo{m) — Fo{m~l). Now suppose 
Fn{m) has been extended to a polynomial of degree n. The recursion tells 
us that F„+i(m) — F„+i(m — 1) can be extended to a polynomial of degree 
n since X^'^i.i 0- the backwards difference of a function is a 

i 

polynomial, then the function itself is a polynomial of one degree higher 
(see [3]). ■ 

The objects of Finite Operator Calculus are polynomial sequences called 
Sheffer sequences. A Sheffer sequence is defined by its generating function, 
which can be written in the following way. 

p{x,t) = sn{x)e = (7(t)e^^(*' 

n>0 

where <T{t) is a power series with a multiplicative inverse and /3{t) is a delta 
series, that is, a power series with a compositional inverse. We say (s„) is 
a Sheffer sequence for the basic sequence (6„) where 

n>0 

Notice that 6„(0) — (5„_o and 60(2^) — 1- 

In order to find the solution to the recurrence, we first transform the 
recursion into an equation with finite operators. For every Sheffer sequence, 
the linear operator B ~ where D = maps s„ to s„_i. The 

operator B also maps its basic sequence 6„ to hn-\ (Rota, Kahaner, and 
Odlyzko jTj). Also if B is a delta operator, that is 

n>l 

where ai ^ 0, then it corresponds to a class of Sheffer sequences associated 
to a unique basic sequence. We do not have to worry about convergence 
since these operators are only applied to polynomials, thus only a finite 
number of the terms will be used for a given polynomial, and thus the 
name Finite Operator Calculus. 

An example of a delta operator that will be frequently used in this paper 
is V = 1 — i?^^, where i?°s„ (a;) =s„(a; + a) is a shift operator. By Taylor's 
Theorem, wc can write 



/(x + a) = ^/(")(x)- or E-^J2- 



_ aD 

n>0 n>0 



in operators. Clearly V is a delta operator. 

If we consider Sn{x) for a; > n — 1 in ([1]), we obtain the operator equation 

\7 ^ B - BE-^ + BE-^. 

We have written one delta operator in terms of an unknown delta operator. 
The following theorem 6, Theorem 1] lets us find the basic sequence for the 
unknown operator B in terms of the basic sequence of the known operator. 

Theorem 5 (Tranfer Formula) Let A be a delta operator with basic se- 
quence an{x). Suppose 

A = t{B)=Y,T,B\ 

where the Tj are linear operators that commute with shift operators, and Ti 
is invertible. Then B is a delta operator with basic sequence 

n ^ 

where [r*] ^ is the coefficient of in r* (t) . 

Notice that this Theorem implies that the unknown operator B is a delta 
operator, and so the underlying polynomial sequence is a Sheffer sequence. 
The final step is to transform this basic sequence into the correct Sheffer 
sequence using the initial values. For ballot paths we have that s„(ri — 1) = 
6nfi, thus the following lemma gives us the solution based on these initial 
values. 

Lemma 6 // (&„) is a basic sequence for B, then 

. , . , bn{x-c) 

tn{x) — (X — an — c) 

X — c 

is the Sheffer sequence for B with initial values tn{an + c) = (5„.o- 



In our case, we would obtain the solution from the basic sequence &„ 
given in the transfer formula as 

s„(^)^(^_„ + l)M^±l) (2) 
X + 1 

called Abelization (2.5)]. We want to remark that given the generating 
function e^^^*^ = X]n>o (^) ^® 

y ,s„ (x) e = e(-+i)^(*) - _^±e^-+mt) = (1 _ (i)) 

All the examples connected to pattern avoidance are of the form 
l-E-^ = V = y^auE^^B^ 

k>l 

where ak,Ck G If this equation can be solved for E, 

E=1 + t{B), 

where r is a delta series, then 

^6„(x)r = (l + r(i)r 

n>0 

We first present the results in [5] which covered bifix-free patterns and 
patterns with exactly one bifix. We then present results for patterns with 
any number of bifixes, hence for any depth-zero pattern. We also give some 
examples and special cases. 

3 Bifix-free patterns 

Let Sn{x;p) be the number of ballot paths avoiding the pattern p; we 
occasionally will drop the p in the notation when convenient. If the pattern 
is bifix-free and depth-zero, we need only to subtract paths that would end 
in the pattern, thus we have the recurrence 

Sn{m;p) = s„_i(m;p) + s„(m - l:p) - s„_a("i - c;p) (3) 

where p has dimensions axe. For example uurrurrur has dimensions 5x4, 
and depth zero. If the pattern has depth zero, and a>c>l,a>2(if 
a = 1 then p = ur, a pattern we do not want to avoid), then it is easy 



to check that the conditions of the Theorem U] are satisfied; the solution is 
polynomial. In operator notation, 



V = 5(1 - B^-^E-"). 

Since the delta operator V can be written as a delta series in B, the 
operator B is also a delta operator. The basic sequence can be expressed 
via the Transfer Formula 

, , , (—1)' f n — (a — fx + n — (a + c ~ l)i — 1 

Using ^ we obtain 
Sn{x) = (x — n + 



1) ("!)' fn-{a~ At + n - (a + c - l)i 

•^-^ X — ci + 1 \ i J \ n — {a — l)i 



i=0 



Therefore the number of ballot paths avoiding p and returning to the 
diagonal (Dyck paths) equals 

^ (-1)* fn~{a-l)i\f2n-{a + c-l)i\ 



— (-1)' fn~{a-l)z\ 
'^-^ n — CI + I \ I I 

i— ^ ^ 



\ n — [a ~ l)i 



4 Patterns with exactly one bifix 

If the pattern p has exactly one bifix, then there exists a unique nonempty 
pattern o such that p = op' o. If p has depth and dimensions axe, and 
p" has dimensions b x d, we have a recurrence of the form 

Snix) = s„_i(a;) + Sn{x - 1) - '^{-iysn-a-bi{x ~c- di) . (4) 

i:>0 

For example let p = urruurr. This pattern is depth-zero, with di- 
mensions 4x3 and bifix o = urr, so 6 = 2 and d = 2. From the paths 
reaching (n — a,a; — c), those ending in p" — urru cannot be included in 
the recurrence and must be subtracted, and from those again we cannot 
include paths ending in urru, and so on. The p" piece of the pattern that is 
responsible for this exclusion-inclusion process may not go below the diago- 
nal; hence it must have d{p") > which lemma [3] guarantees. If d{p") < 0, 
then at some point we would be using numbers below the y = x boundary, 
which are only the polynomial extensions and do not count paths. 



In operators, we have 



or 



1 + BbE-d 
i>0 



V = S + B''+^E-^ + B^E-'^-'^ - B^-E-" - B^E-'^ (5) 
= B- B°-E-'' + B^+^E-'^ - B^E-'^V. 



Using the Transfer Formula, we obtain bn{x) = 



3,k,l>0 



n 



{a-l)j -bk-{b-l)l\ 



j,k,l J n — {a — l)j — bk — {b — 1)1 



X 



n - (a + c - l)j - (5 + d){k + I) - 1 + x 
n- ia-l)j ~b{k + l) -1 



Because s„(n — 1) = Sq ^ wc get s„(a;) = 

- (a - l)j -bk-{b- {-iy+\x - n + 1) 



j,k,l>0 



j,k,l J n — (a — l)j — bk — [b — 1)1 



n - (a + c - l)i -{b + d){k + I) + x 
n-{a-l)j-b{k + l)-l 

So for the pattern urruurr, we obtain Sn{x) = 
j2 fn-3j -2k-l\i-l)^+'{ ■T — n + 1) /n — 6j — 4(fc + I) + : 
j,k,l>0 ^ 



j,k,l J n-3j-2k-l \n - 3j - 2{k + I) - ij ' 
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The number of ballot paths avoiding urruurr 



5 A Special Case 



The above operator equation ([5]) simplifies when a = b + l and c = d. This 
corresponds to a pattern of the form rp'r. For this case we get 



B{1 + B''E-'^) 



and 

Snix) = (cc - n + 1) 



(-1)* (n-{b- l)i ~1\ (x + n~ {d + b)i -I 



i>0 



{-ly fn-{b-l)i-l\fx + n-{d + b)i 



X — di + 1 \ i J \ n — bi 

i>0 



The number of Dyck paths equals 

(-1)* fn- {b-l)i-l\ f2n- {d + b)i 



n — di + 1\ i J \ n — bi 

The first pattern we considered, rur, is of this form where b = d = 1. 
The solution in this case is 



Sn{x) = (a; - n + l)y^ 

j>0 



and the number of Dyck paths equals 



(-1)'' fn-l\ fx + n~2i 



^-^ n — I + 1 \ I I \ n — I I ^-^ 



i>0 



where C„ is the nth Catalan number. 



6 Patterns with any number of bifixes 

Now we suppose that the pattern p has m distinct bifixes oi, . . . , o,„. Let 
bi X di be the dimensions of p", the pattern -p without the suffix Oi, and 
a X c be the dimensions of p. The number of ways to reach the lattice point 
(n — a — 'Y^ijbj^x — c — 'Y^ ijdj) with fc > combinations of the with 



ij — k is ( . . I with sign (—1)'^. Then the recurrence for the 

bahot paths avoiding p is 

s„(x) = s„_i(x) + s„(x-l)-^(-l)'' (6) 

fc>0 



X 

ilH him='£ 



, . . . , (-^ 



In operators, 

- B (7) 

1 + B^^E-'^- 

1=0 

In general, we can find the basic sequence for any depth zero pattern 
via the transfer formula, although it would involve many summations. We 
now consider an example and some special cases. 

Example 7 The pattern rururrur has two hifixes, rur andr. In this case, 
a = 5, c = 3, 6i = 3, di = 2, 62 = 4 and d2 = 3. Using the above operator 
equation, we obtain 

V = B- 



1 + B^E-^ + B^E-^ 
B + B'^E-^ 



1 + B^E-^ + B^E-^ 
Using the transfer formula and 



1 



i=0 j">0 A;>0 

^x — n + 2i+j + k — 1 



n — i — 3j — 3kjx — n + i+ j + k 



and 

n 

yj J \ k J \n — i — 3j — 3k 



.„(x) = (---+i)EEE(- ^ 

i=0 j>0 k>0 



1 fx-n + 2i+j + k 



X — n + i+ j + k + l\ i 
6.1 Patterns of the form 

We had previously determined in [4] by other methods that the recurrence 
formula for this pattern is 

S„(x) = S„_i(x) + Sn{x - 1) - S„_a(.T - 1) 

giving the operator equation 

a-l 

V = B - B''E-^ or E^^B\ 

i=0 

Using the new formula ([7]), we view r° as a pattern with a — 1 bifixes. 
Here c = di — and bi — i for all < i < a — 1, thus the operator equation 
becomes 

V = B = 1 or E = Y^ B ' 

i=l i=0 

as expected. 



6.2 Patterns of the form r{urY 

If the pattern is of the form r{ur)^ , then a = fc + l,c=:fc, and for each 
< i < fc there is the bifix r{ury . So, hj = dj = j for 1 < j < k. Let 
S = BE^^ . We obtain the following operator equation for this pattern, 

V ^ B 



V = B\l- 



1 + 5 + 5*2 + • • ■ + S''' 



1 + 5 + 52 + • • ■ + 5*^ 
Using the Transfer Formula, 

' i\ f — J \ 1 — n + 2i — 1 



— — \i 1 \n — i — kj 1 , , T X — n + i\ i 

i=0 j>0 \ -J/ fc+i \ 



where ( ^ ) := + tH \-t^)'= 3]. The number of BaUot paths is 

V'^/ k+i 

Sn{x) = 

We obtain a very nice formula for the Dyck paths in this case, 



i=0 j>0 

where Cn is the nth Catalan number. 
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